Augmented Reality Location Operation Using Augmented Reality Tape

ABSTRACT

A method for performing an augmented reality location operation. The augmented reality location operation includes: attaching an augmented reality tape to a component, the augmented reality tape comprising a plurality of unique identifiers; identifying an augmented reality target via an augmented reality tracking method, the augmented reality target comprising the unique identifier of the augmented reality tape; and, generating an augmented reality projection to a location on the component based upon the identifying the augmented reality target.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to information handling systems. Morespecifically, embodiments of the invention relate to an augmentedreality location operation which includes augmented reality trackinghandoff.

Description of the Related Art

As the value and use of information continues to increase, individualsand businesses seek additional ways to process and store information.One option available to users is information handling systems. Aninformation handling system generally processes, compiles, stores,and/or communicates information or data for business, personal, or otherpurposes thereby allowing users to take advantage of the value of theinformation. Because technology and information handling needs andrequirements vary between different users or applications, informationhandling systems may also vary regarding what information is handled,how the information is handled, how much information is processed,stored, or communicated, and how quickly and efficiently the informationmay be processed, stored, or communicated. The variations in informationhandling systems allow for information handling systems to be general orconfigured for a specific user or specific use such as financialtransaction processing, airline reservations, enterprise data storage,or global communications. In addition, information handling systems mayinclude a variety of hardware and software components that may beconfigured to process, store, and communicate information and mayinclude one or more computer systems, data storage systems, andnetworking systems.

SUMMARY OF THE INVENTION

In one embodiment the invention relates to a method for performing anaugmented reality location operation comprising: attaching an augmentedreality tape to a component, the augmented reality tape comprising aplurality of unique identifiers; identifying an augmented reality targetvia an augmented reality tracking method, the augmented reality targetcomprising the unique identifier of the augmented reality tape; and,generating an augmented reality projection to a location on thecomponent based upon the identifying the augmented reality target.

In another embodiment the invention relates to an apparatus comprisingan augmented reality tape, the augmented reality tape comprising aplurality of unique identifiers; and, an attachment means, theattachment means enabling the augmented reality tape to be attached to acomponent; and wherein the plurality of unique identifiers enable anaugmented reality device to identify an augmented reality target, theaugmented reality target comprising at least one of the plurality ofunique identifiers of the augmented reality tape; and, the augmentedreality device generates an augmented reality projection to a locationon the component based upon the identifying the augmented realitytarget.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention may be better understood, and its numerousobjects, features and advantages made apparent to those skilled in theart by referencing the accompanying drawings. The use of the samereference number throughout the several figures designates a like orsimilar element.

FIG. 1 shows a general illustration of components of an informationhandling system as implemented in the system and method of the presentinvention.

FIG. 2 shows a block diagram of a server rack having a plurality ofinformation handling systems.

FIG. 3 shows a block diagram of a data center.

FIG. 4 shows a perspective view of a portion of a data center.

FIG. 5 shows a flow chart of a unique identifier placement operation.

FIG. 6 shows a flow chart of an augmented reality unique identifierplacement operation.

FIG. 7 shows a flow chart of an augmented reality tracking handoffoperation.

FIG. 8 shows a perspective view of an active augmented reality tapecomponent with a portion of the tape extended.

FIG. 9 shows a perspective view of an active augmented reality tapecomponent with the tape retracted.

FIG. 10 shows a perspective view of a portion of a server rack of a datacenter with an active augmented reality tape component with a portion oftape extended.

FIG. 11 shows a perspective view of a passive augmented reality tape.

FIG. 12 shows diagrammatic block diagram of an example roll of a passiveaugmented reality tape.

DETAILED DESCRIPTION

Certain aspects of the present disclosure reflect an appreciation thatan issue associated with augmented reality (AR) location identificationrelates to augmented reality drift. Certain aspects of the presentdisclosure reflect an appreciation that AR drift is often caused byreliance on a single AR tracking method where the single AR trackingmethod may initially work well initially but cause accuracydeterioration over time. Various aspects of the present disclosureinclude an appreciation that accuracy deterioration may be determinedusing a confidence score. Certain aspects of the present disclosurereflect an appreciation that AR drift can introduce serious errors whenperforming AR operations such as when an AR projection becomesmis-aligned with the physical hardware associated with the ARprojection. Certain aspects of the present disclosure include anappreciation that AR drift can be an especially troubling issue when ARis used within an IT environment such as a data center. Certain aspectsof the present disclosure include an appreciation that AR drift can bean especially troubling issue when projecting AR projections within theIT environment.

Certain aspects of the present disclosure reflect an appreciation thatAR drift can be caused due to an insufficient number of AR targetsand/or tracking methods, or weak/nonexistent relationships between ARtargets. Certain aspects of the present disclosure include anappreciation that many known AR applications use a single trackingmethod to catalogue one type of target. Certain aspects of the presentdisclosure include an appreciation that AR drift can be an especiallytroubling issue when AR is used within an IT environment such as a datacenter.

A system, method, and computer-readable medium for performing an ARlocation identification operation are disclosed. An augmented realitylocation identification operation is one example of an augmented realitylocation operation. In certain embodiments, the AR locationidentification operation uses a plurality of AR tracking methods torecognize common and unique AR targets. In certain embodiments, the ARlocation identification operation continuously uses the plurality of ARtracking methods. In certain embodiments, the AR location identificationoperation records relative two dimensional or three dimensionalcoordinates of the common and unique AR targets in a database. Incertain embodiments, the recorded coordinates provide a catalogue ofpoints. These catalogued points can be recalled when a recorded targetis within the field of view of an AR device. Such a catalog provides arobust database to project AR overlays accurately, even when the fieldof view is limited to a subset of items that would not otherwise berecognizable.

An augmented reality drift reduction operation is an example of anaugmented reality location operation. In certain embodiments, theaugmented reality drift reduction operation uses a plurality of ARtracking methods and compares the strength of certain various ARtracking methods to prioritize and select (handoff) a preferable ARtracking method. In certain embodiments, the preferable AR trackingmethod provides the most accurate AR projection for a user's point ofview. In certain embodiments, the augmented reality drift reductionoperation uses a confidence score generated for each available trackingmethod to determine whether to handoff to a different AR trackingmethod. In certain embodiments, handing off to a different AR trackingmethod establishes a new origin for AR tracking and provides a moreaccurate AR projection (i.e., an AR projection which is more closelyaligned with the physical hardware associated with the AR projection).

For purposes of this disclosure, an information handling system mayinclude any instrumentality or aggregate of instrumentalities operableto compute, classify, process, transmit, receive, retrieve, originate,switch, store, display, manifest, detect, record, reproduce, handle, orutilize any form of information, intelligence, or data for business,scientific, control, or other purposes. For example, an informationhandling system may be a personal computer, a network storage device, orany other suitable device and may vary in size, shape, performance,functionality, and price. The information handling system may includerandom access memory (RAM), one or more processing resources such as acentral processing unit (CPU) or hardware or software control logic,ROM, and/or other types of nonvolatile memory. Additional components ofthe information handling system may include one or more disk drives, oneor more network ports for communicating with external devices as well asvarious input and output (I/O) devices, such as a keyboard, a mouse, anda video display. The information handling system may also include one ormore buses operable to transmit communications between the varioushardware components.

FIG. 1 is a generalized illustration of an information handling system100 that can be used to implement the system and method of the presentinvention. The information handling system 100 includes a processor(e.g., central processor unit or “CPU”) 102, input/output (I/O) devices104, such as a display, a keyboard, a mouse, a touchpad or touchscreen,and associated controllers, a hard drive or disk storage 106, andvarious other subsystems 108. In various embodiments, the informationhandling system 100 also includes network port 110 operable to connectto a network 140, which is likewise accessible by a service providerserver 142. The information handling system 100 likewise includes systemmemory 112, which is interconnected to the foregoing via one or morebuses 114. System memory 112 further comprises operating system (OS) 116and in various embodiments may also comprise AR location identificationsystem 118. In one embodiment, the information handling system 100 isconfigured to download the AR location identification system 118 fromthe service provider server 142. In another embodiment, the AR locationidentification system 118 is provided as a service from the serviceprovider server 142.

In various embodiments, the information handling system 100 communicateswith an AR device 130. In various embodiments, the AR device 130communicates with the AR location identification system 118. In variousembodiments, the AR device itself comprises an information handlingsystem. In various embodiments, the AR location identification system118 executes on the information handling system 100, the AR device 130or a combination of the information handling system 100 and the ARdevice 130. In various embodiments, the AR device 130 can include one ormore of an AR headset and a mobile device such as a mobile phone ortablet. Generally, an AR device 130 includes a camera as well as a meansof visually providing information such as a display device whichinteracts with the camera. In various embodiments, the informationhandling system communicates with the AR device 130 via an input/outputdevice 104. In various embodiments, the information handling systemwirelessly communicates with the AR device 130 such as via a WiFiconnection or a Bluetooth connection.

FIG. 2 shows an environment for augmented reality detection ofenterprise systems in a data center. The environment 200 includes theinformation handling system 100 described in FIG. 1 . In certainembodiments, the information handling system 100 includes augmentedreality location identification system 118 and hard drive/disk 106 alsoreferred to as database/storage 106. In certain implementations, theinformation handling system 100 includes an AR device access point 202.The AR device access point 202 provides for a connection access to an ARdevice 204. In certain embodiments, a wireless connection 206 (such as aRadio Frequency (RF) connection) is maintained between the AR deviceaccess point 202 and AR device 204.

In certain embodiments, the information handling system 100 connectswith a data center management system 208 through the network 112. Thedata center management system 208 can be a cloud hosted machine or auser deployed enterprise solution. The data center management system 208can have information and data as to hardware and configuration of datacenters and is used to manage configuration and inventory of datacenters. In certain embodiments, a data center administrator 210 througha data center administrator system 212 interacts with the data centermanagement system 208. In certain embodiments, one or both theinformation handling system 100 and the data center management system208 connect with an AR database 216 via the network 112. In certainembodiments, the AR device 204 may also communicate directly with the ARdatabase 216.

In certain implementations, the AR device 204 includes one or more of acamera 220, an accelerometer 222, a received signal strength indication(RSSI) module 224, a location awareness component 226 and one or moreother sensors 228. Camera 220 can be implemented with lenses havingparticularly focal lengths. In certain embodiments, determining a focalpoint of camera 220 is used in augmented reality to determine physicalsize of an image, such as an object in an enterprise system. In certainimplementations, the accelerometer 222 is used to generate accelerometerdata to calculate three-dimensional orientation of an enterprise systemand objects, relative to the camera view. In certain implementations,the RSSI module 224 is used to determine signal strength between the ARdevice 204 and the AR device access point 202 of information handlingsystem 100. In certain embodiments the signal strength can be used tocalculate a relative distance. The relative distance can be correlatedto measurements of objects in the enterprise system 234. In certainembodiments, the other sensors 228 can include one or more of aBluetooth sensor such as a Bluetooth low energy (BLE) sensor, a globalpositioning system (GPS) sensor, a light detection and ranging (LIDAR)sensor and a compass. In various embodiments, the other sensors generaterespective sensor information which can be used when performing ARtracking operations.

The camera 220 is configured to capture images of a data center 232, andparticular enterprise systems 234 (i.e., data center assets) of the datacenter 232. In certain embodiments, AR device 204 can present imagescaptured by the camera 220 along with augmented reality images,including videos of enterprise systems 232 and objects, such as hardwarethat make up enterprise systems 234. The augmented reality images areexamples of AR projections. As used herein, an AR projection broadlyrefers to a rendering which is overlaid to align with a relevant objectlocated within the point of view (POV) of the user. In variousembodiments, the rendering may be one or more of a static rendering anda motion rendering. As used herein, point of view broadly refers to auser perspective of a portion of a physical environment. In variousembodiments, images representing the point of view are presented withina display device of the AR device 204. Such augmented reality images maybe provided to the information handling system 100 and the augmentedreality location identification system 118. In certain implementations,a user 230 can identify particular enterprise systems 234 of data center232 based upon the captured images as well as information stored withinthe database 216.

In certain embodiments, the AR location identification system 118performs an AR location identification operation. In certainembodiments, the AR location identification operation uses a pluralityof AR tracking methods to recognize common and unique AR targets. Asused herein, an AR tracking method broadly refers to an electronic inputused to provide location information, often in real time, for an ARdevice and its surroundings. In various embodiments, the AR trackingmethod can include one or more of visual information and other sensorinformation. In various embodiments, the visual information can includeinformation generated from one or more of image recognition, objectrecognition, room recognition and bar code scanning operations. Invarious embodiments, the other sensor information can includeinformation generated from one or more of a Bluetooth sensor such as aBluetooth low energy (BLE) sensor, a global positioning system (GPS)sensor, a light detection and ranging (LIDAR) sensor, an accelerometerand a compass.

The location information can then be used such as for placement of ARprojections. In certain embodiments, the AR location identificationoperation continuously uses the plurality of AR tracking methods. Incertain embodiments, the AR location identification operation recordsrelative two dimensional or three dimensional coordinates of common andunique AR targets in a database. In certain embodiments, the recordedcoordinates provide a catalogue of points. These catalogued points canbe recalled when a recorded target is within the field of view of an ARdevice. Such a catalog provides a robust database to project AR overlaysaccurately, even when the field of view is limited to a subset of itemsthat would not otherwise be recognizable.

In certain embodiments, some or all unique identifiers may be placed viaan augmented reality unique identifier placement operation. In variousembodiments, the augmented reality unique identifier placement operationis an example of an augmented reality location operation. In general,the augmented reality unique identifier placement operation starts withan AR device 204 identifying a known target from the field of view ofthe AR device 204. Next, a new target is added to the environmentrelative to the known target. Next, the known target is scanned with theAR device and the position of the known target is identified. Next, thenew target with the field of view of the AR device is scanned and theposition of the new target is identified. Next, the position of the newtarget relative to the known target location is recorded. In variousembodiments, a simultaneous localization and mapping (SLAM) operation isused when identifying the various locations within the environment. Asused herein, a SLAM operation refers to a computational method ofconstructing or updating a map of a data center environment (whether thedata center environment is known or unknown) while simultaneouslytracking a location of an AR device within the data center environment.In various embodiments, the locations are identified within confidentcomputations limits of SLAM.

FIG. 3 shows a block diagram of a data center environment 300 having aplurality of server type information handling systems (e.g., data centerassets). In certain embodiments, the server environment 300 includes oneor more server racks 310. In certain embodiments, the server racks 310maybe located within a data center. In certain embodiments, each servertype information handling system corresponds to an information handlingsystem 100.

As used herein, a data center broadly refers to a building, a dedicatedspace within a building, or a group of buildings, used to house acollection of interrelated data center assets implemented to work incombination with one another for a particular purpose. As likewise usedherein, a data center asset broadly refers to anything tangible, orintangible, that can be owned, controlled, or enabled to produce valueas a result of its use within a data center. In certain embodiments, adata center asset may include a product, or a service, or a combinationof the two. In certain embodiments, a data center asset includes aninformation handling system. In certain embodiments, a data center assetcan include one or both of a unique identification characteristic 320and a common identification characteristic 322. In certain embodiments,a plurality of common identification characteristics 322 can provide aunique identification characteristic. In certain embodiments, the one orboth the unique identification characteristics 320 and the commonidentification characteristics 322 can be used as AR targets. In certainembodiments, one or more unique identification characteristics 320 canbe used as a unique identification target. In certain embodiments, aplurality of common identification characteristics 322 can be used as aunique identification target.

FIG. 4 shows a perspective view of an augmented reality IT environment400. The IT environment 400 includes a data center rack 410 whichincludes a plurality of information handling systems 100. In variousembodiments, the physical portion of the IT environment 400 can includethe front, the rear or the interior of a particular information handlingsystem 440 mounted within the data center rack 410 of the IT environment400.

In various embodiments, the data center rack 410 can include one or morecolumns 430. In various embodiments, each of the one or more columns 430can include one or more data center assets. In various embodiments,respective data center assets can include one or more uniqueidentification characteristics (e.g., unique identificationcharacteristic 320) and common identification characteristics (e.g.,common identification characteristics 322). In various embodiments, theunique and common identification characteristics can function asaugmented reality targets. In certain embodiments, one or more columns430 can be associated with an augmented reality tape. The associatedaugmented reality tape can include an active augmented reality tape 450and a passive augmented reality tape 452. An augmented reality tape canextend across an entire height of a column or may expend down a portionof a column. It will be appreciated that AR tapes can be positioned inmany locations within a data center. For example, an AR tape might bepositioned horizontally either across the top, the bottom or somewherebetween the top and bottom of a data center asset rack. An AR tape mightalso be extended across a floor in front of a data center asset rack.

As used herein, an augmented reality tape broadly refers to a narrow(e.g., <2 inch) flexible strip at least a portion of includes a uniqueidentifier. In various embodiments, the unique identifier includes oneor more of a QR code and one or more unique identificationcharacteristics. In various embodiments, the augmented reality tapecomprises an adhesive augmented reality tape. With an adhesive augmentedreality tape, some or all of a side of the augmented reality tapeincludes an adhesive. In various embodiments, the augmented reality tapecomprises a magnetic augmented reality tape. With a magnetic augmentedreality tape, some or all of the augmented reality tape includes amagnet.

In various embodiments, the AR tape includes one or more of an activeaugmented reality tape component and a passive augmented reality tape.In various embodiments, an active augmented reality tape is includedwithin an active augmented reality tape component. In variousembodiments, an active augmented reality tape component includes acontrol portion 470 and a tape portion 472. With an active augmentedreality tape component, the magnet may be included in the controlportion 470 of the augmented reality tape component and a tape endportion of the augmented reality tape component. Additional magnets maybe included on a side of the tape to magnetically attach the activeaugmented reality tape component to a portion of a data center as the ARtape is extended. In various embodiments, the active augmented realitytape component may be attached to a data center rack column on which anaugmented reality projection is intended to be used (e.g., a rack onwhich a service technician intends to work).

As used herein, a unique identification characteristic broadly refers toa characteristic which is associated with a particular data centerasset. In various embodiments, the unique identification characteristicmay be detected by the AR device. In various embodiments, a uniqueidentifier of AR tape includes a unique identification characteristic.In various embodiments, the characteristics may be visually detected bythe camera of the AR device. In various embodiments, the uniquecharacteristics may be detected using a combination of one or more ofthe camera, the accelerometer, the RSSI module and the locationawareness of the AR device. Examples of a unique identificationcharacteristic include a QR code, an AR bar, an AR tape, an AR stickerand a physically encoded bezel.

As used herein, a common identification characteristic broadly refers toa characteristic which can be associated with one or more data centerassets. In various embodiments, the common identification characteristicmay be detected by the AR device. In various embodiments, the commonidentification characteristics may be visually detected by the camera ofthe AR device. In various embodiments, the common identificationcharacteristics may be detected using a combination of one or more ofthe camera, the accelerometer, the RSSI module and the locationawareness of the AR device. Examples of a common identificationcharacteristic include a part number identifier, bezel characteristics(e.g., bezel height, width, color, shape).

FIG. 5 shows a flow chart of an augmented reality target locationgeneration operation 500. An augmented reality target locationgeneration operation is one example of an augmented reality locationoperation. In various embodiments, the augmented reality target locationgeneration operation 500 includes one or both of a handoff portion 502and a location identification portion 504. The handoff portion 502begins at step 510 with an AR device 204 executing in an inventory modeof operation. As used herein, an inventory mode of operation refers to amode of operation during which the augmented reality device observes itssurroundings with a goal of obtaining one or more data centeridentification characteristics. Next, at step 512 the AR device 204accesses a geometry database such as an AR database and determines thatthere are no AR targets tracked by the database. Next, at step 514 whenobserving its surroundings, the AR device 204 identifies an AR target.When an AR target is identified, the augmented reality target locationgeneration operation 500 transitions to the location identificationportion 504.

Next, at step 520, the augmented reality target location generationoperation 500 determines whether the AR target is unique. In variousembodiments, the AR target may be considered unique when anidentification characteristic of the AR target includes a uniqueidentification characteristic. If the AR target is not unique, then theaugmented reality target location generation operation 500 proceeds tostep 522 to determine whether the identified AR target has an associatedlocation entry stored within the AR database. If the AR target does nothave an associated location entry, then the augmented reality targetlocation generation 500 operation proceeds to step 524 during which theAR device 204 determines that the identified AR target cannon be used asan anchor for calculating relative geometry between targets.

When the AR target is determined to be unique at step 520 or when the ARtarget has an associated entry stored in the database as determined atstep 522, the augmented reality location identification operation 500proceeds to step 530 during which the AR device 204 determines that theidentified target can be used for calculating relative geometry oftargets. Next at step 532 a location entry is added to the database. Invarious embodiments, the location entry includes X, Y and Z coordinateinformation When the location entry for this AR target is the firstentry, the location entry is recorded as a point of origin. In variousembodiments, the point of origin may be recorded with a location of0,0,0. When the location entry for this AR target is other than thefirst entry (i.e., a secondary entry), the location entry is recordedwith information relative to a point of origin. In various embodiments,the information relative to the point of origin may have a positive,zero or negative value. In various embodiments, the information relativeto the point of origin may be X, Y and Z coordinates relative to thepoint of origin (e.g., 200,−50, 35).

Next at step 540, the AR device 204 tracks its position as the AR device204 attempts to observe its next AR target. In various embodiments, theposition of the AR device 204 may be tracked based upon one or both ofits offset and movement. In various embodiments, a plurality of ARtracking methods are used when tracking the position of the AR device204. Next, at step 542 another AR target is identified and the positioninformation is associated with this AR target. Next, the augmentedreality target location generation operation 500 returns to step 520when another AR target is identified.

FIG. 6 shows a flow chart of augmented reality unique identifierplacement operation 600. An augmented reality unique identifierplacement operation is an example of an augmented reality locationoperation. In various embodiments, the unique identifier placementoperation 600 makes use of one or more of an AR anchor dongle and aunique target such as an AR sticker to reduce AR drift. As used herein,an AR anchor dongle broadly refers to a device which includes visualindicia designed to be easily accessed and interpreted by an AR device.In various embodiments, an AR anchor dongle also includes physicalcharacteristics (e.g., notches and projections) which facilitatephysically coupling the AR dongle with a particular location in a datacenter. In various embodiments, the physical characteristics allow theAR anchor dongle to be attached to a particular location of a serverrack within a data center. As user herein, an AR sticker broadly refersto a substantially two dimensional component which may be physicallyattached to a particular location within a data center. In variousembodiments, the AR sticker includes a unique identifier. In variousembodiments, the unique identifier includes a quick response (QR) coderepresentation. In various embodiments, the AR sticker includes a meansfor attaching the AR sticker to a particular location within a datacenter. In various embodiments the means for attaching can include oneor more of an adhesive portion and a magnetic portion. In variousembodiments, the AR sticker functions as an augmented reality markeronce the position (whether relative or actual) is recorded within an ARdatabase. As used herein, an AR marker broadly refers to a twodimensional graphic which can be used by an AR device for digitallytracking an object relative to the position of the AR marker in threedimensional space.

In various embodiments, the unique identifier placement operation 600begins at step 610 with a user being instructed to physically couple anAR anchor dongle to a particular location of a data center. In variousembodiments, the instruction can include instructing the user to insertthe AR anchor dongle to a particular location in a server rack. Invarious embodiments, the particular location is represented as a rackunit (RU) location within a particular server rack. In variousembodiments, a particular RU location includes a three hole set ofapertures within a side of a server rack. In various embodiments, the ARdongle is physically coupled by insert the AR dongle to particular rackrail mounting apertures. In certain embodiments, the instructions caninclude an AR projection providing a visual indication of how tophysically couple the AR anchor dongle with the rack. Next, at step 612the user physically attaches the AR anchor dongle to the particularlocation on the server rack.

Next at step 620, the user scans the AR anchor dongle with an AR device.Next at step 622, the user provides AR anchor location informationregarding the physical placement of the AR anchor dongle. In variousembodiments, the AR anchor location information can include one or moreof to which particular rack within a data center the AR anchor dongle isattached, the particular rack unit to which the AR anchor dongle isattached and whether the AR anchor dongle is attached to the right orleft of the particular rack. In various embodiments, this AR anchordongle location information can be stored within an AR database.

Next at step 630, the user is instructed to attach a unique identifierin proximity to the location in the data center to which the AR anchordongle is attached. In various embodiments, the unique identifierincludes an AR sticker. Next at step 632 the user physically attachesthe unique identifier proximate to the location in the data center towhich the AR anchor dongle is attached.

Next at step 640, the user scans the unique identifier via the ARdevice. The position of the unique identifier is then determinedrelative to the location of the AR anchor dongle. Because the locationof the AR anchor dongle within the data center is known, the position ofthe unique identifier is also known. Thus, the unique identifier canalso be used by the AR device as a unique target. The unique identifierlocation information is stored within the AR database. In certainembodiments, the relative location of the unique identifier may beobtained via a SLAM operation. Next at step 642, the user is instructedto remove the AR anchor dongle as the AR anchor dongle is no longernecessary to provide a unique AR target for the AR device.

By providing one or more unique identifiers with known locations withinthe data center environment, AR drift may be minimized whenever such aunique target is within the field of view (FOV) of the AR device. Byhaving a known location associated with the unique identifier, trackingmethods may more accurately identify a location of a point of view ascompared to methods which do not make use of known identifiers. As usedherein, a field of view of an AR device broadly refers to the locationof an AR device identified via sensory inputs that fall within animmediate purview of the AR device (i.e., sensory inputs that areimmediately accessed by the AR device. An immediate purview of the ARdevice may also take into account the peripheral purview of the ARdevice (i.e., sensory inputs that are close but not immediately accessedby the AR device). It will be appreciated that the field of view of theAR device may be larger (i.e., may encompass more space) than a pointoverview of the AR device.

In various embodiments, the unique identifier placement operation 600makes use of one or more of an AR anchor dongle and a unique target suchas an AR sticker or an AR tape to reduce AR drift. As used herein, an ARanchor dongle broadly refers to a device which includes visual indiciadesigned to be easily accessed and interpreted by an AR device. Invarious embodiments, an AR anchor dongle also includes physicalcharacteristics (e.g., notches and projections) which facilitatephysically coupling the AR dongle with a particular location in a datacenter. In various embodiments, the physical characteristics allow theAR anchor dongle to be attached to a particular location of a serverrack within a data center. As user herein, an AR sticker broadly refersto a substantially two dimensional component which may be physicallyattached to a particular location within a data center. In variousembodiments, the AR sticker includes a unique identifier. In variousembodiments, the unique identifier includes a quick response (QR) coderepresentation. In various embodiments, the AR sticker includes a meansfor attaching the AR sticker to a particular location within a datacenter. In various embodiments the means for attaching can include oneor more of an adhesive portion and a magnetic portion.

It will be appreciated that an AR tape may or may not make use of an QRdongle to be attached to a particular location when performing anaugmented reality location operation. For example, the AR tape by itselfcan include enough unique information to identify a particular locationwithin a data center. Once the particular location is identified, otherunique or common AR targets can be location using relative positions.

By providing one or more unique identifiers with known locations withinthe data center environment, AR drift may be minimized whenever such aunique target is within the field of view (FOV) of the AR device. Byhaving a known location associated with the unique identifier, trackingmethods may more accurately identify a location of a point of view ascompared to methods which do not make use of known identifiers. As usedherein, a field of view of an AR device broadly refers to the locationof an AR device identified via sensory inputs that fall within animmediate purview of the AR device (i.e., sensory inputs that areimmediately accessed by the AR device. An immediate purview of the ARdevice may also take into account the peripheral purview of the ARdevice (i.e., sensory inputs that are close but not immediately accessedby the AR device). It will be appreciated that the field of view of theAR device may be larger (i.e., may encompass more space) than a pointoverview of the AR device.

FIG. 7 shows a flow chart of an augmented reality tracking handoffoperation 700. The augmented reality tracking handoff operation 700starts at step 710 with no AR tracking method selected. Next at step712, possible tracking methods are identified. When identifier possibletracking methods a plurality of tracking methods are reviewed todetermine whether one or more of the plurality of tracking methods arewith the visible limits of the AR device. If there are no trackingmethods within the visible limits of the AR device, which corresponds tozero tracking methods, then the augmented reality projection function ofthe AR device is turned off at step 714. If the field of view of the ARdevice changes, then control returns to step 712 to identify possibletracking methods.

If there is single tracking within the visible limits of the AR devicethen AR projection is turned on at step 720. With this step, ARprojection on the AR device executes with the single tracking method. AnAR tracking method confidence score associated with the tracking methodis repeatedly evaluated during step 722. Additionally, the field of viewof the AR devices is repeatedly reviewed during step. Eventually, likelydue to AR drift, the AR tracking method confidence score decreases to bebelow a confidence level threshold. When the AR tracking methodconfidence score decreases to be below the confidence level threshold,control returns to step 712 to identify possible tracking methods.Alternately or additionally, if the field of view of the AR devicechanges, then control returns to step 712 to identify possible trackingmethods.

If more than a single tracking is within the visible limits of the ARdevice, then control transfers to step 730. During step 730, theidentified AR tracking methods are evaluated to determine which of theidentified tracking method provides a higher resolution of the ARtarget. As used herein, higher resolution broadly refers to how closelyan identified location of an AR target aligns with an actual location ofthe AR target. In certain embodiments, the determination of whetheranother tracking method provides a higher resolution of the AR targetincludes generating an AR tracking confidence score for each of theplurality of AR tracking methods and the determining identifies an ARtracking method having a higher AR tracking method confidence score. TheAR tracking method with the highest AR tracking method confidence scoreis identified for handoff. Next, at step 732, the operation determineswhether the tracking method identified for handoff differs from thecurrently active AR tracking method. If the tracking method with thehighest AR tracking method confidence score is the presently selectedtracking method, then no handoff occurs and AR projection continues atstep 734 and control returns to step 712 to continue to identifypossible tracking methods.

Next at step 740 a handoff occurs where the active AR tracking method isassigned to the tracking method which was selected at step 732. Duringthe handoff, positional metrics from the previous AR tracking method arecaptured and provided to the new active AR tracking method. In variousembodiments, the positional metrics include contextual data which wouldotherwise not be exposed to the new active tracking method. In certainembodiments, the tracking handoff provides the same tracked data setrelative to different size scales and different points of view.

In various embodiments, the AR tracking method confidence score isgenerated based upon at least one augmented reality factor. In variousembodiments, the one or more factors include at least one physicalfactor (also referred to as an object detection factor), at least onelighting condition factor, at least one predictive analysis factor, andat least one field of view prioritization factor. In variousembodiments, the physical factor provides information regarding arecognized physical object (e.g., a server or portion of a server). Theinformation may include or be associated with an image of the recognizedphysical object. In various embodiments, the lighting condition factorprovides an indication of whether light or dark conditions are presentin the present field of view. When dark conditions are present, the ARtracking method confidence score deprioritizes visual tracking methodsand promotes other sensor methods such as gyroscope, LIDAR, etc. Invarious embodiments, the predictive analysis factor takes into accountvector information and velocity information associated with the ARdevice. In various embodiments, the field of view prioritization factorprovides an indication of a field of view level from a plurality offield of view levels. In various embodiments, based upon the field ofview level, certain tracking methods may be deprioritized whereas othertracking methods may be promoted. For example, if the AR device ispositioned relatively far from a server rack, server level trackingmethods may be deprioritized whereas rack and room level trackingmethods may be promoted. In various embodiments, the field of view levelmay include one or more of a port field of view level, a server field ofview level, a multi-unit (i.e., a constellation) field of view level, arack field of view level, a multi rack field of view level, an aislefield of view level and a room field of view level.

For example, when using an image tracking method, an AR device hasinformation regarding which images can be identified by the AR device.When the AR device recognizes all or part of a captured image, the ARdevice triggers a comparison of the known target data and the observedtarget data, which in this case includes pixel data. This comparison isused to determine a percentage the observed target matches the knowntarget. In various embodiments, this percentage is used to generate anAR tracking method confidence score for the image tracking method. Invarious embodiments, the AR tracking method confidence score uses ascale from 0-100. A similar method can be used when the AR deviceobtains other known target data such as objects, areas, ground planesetc.

For example, an AR tracking method confidence score may be set to 100for an AR tracking method when the AR target is within the immediatepurview of the AR device (e.g., is close to the target). An AR trackingmethod confidence score of 100 indicates a high likelihood that no ARdrift is present for the associated AR tracking method. An AR trackingmethod confidence score may be set to 75 when the AR target is withinimmediate purview of AR device, but the target is either at a distanceor partially obstructed from the AR device. An AR tracking methodconfidence score of 75 indicates the AR target is recognized but ARdrift may occur for the associated AR tracking method. An AR trackingmethod confidence score may be set to 50 when the AR target is beingtracked with a peripheral purview (e.g., by using a SLAM operation) ofthe AR device. An AR tracking method confidence score of 50 indicatesthe AR target just exited immediate purview of the AR device.

An AR tracking method confidence score may be set to 25 when the ARtarget is being tracked with peripheral purview (e.g., by using a SLAMoperation) of the AR device. An AR tracking method confidence score of25 indicates the AR target has larger exit from immediate purview of theAR device. Such a score may also prompt an indication to attempt toobtain another AR target. An AR tracking method confidence score may beset to 0 when the AR target is not recognized by the associated ARtracking method of the AR device. An AR tracking method confidence scoreof 0 indicates that the AR tracking method is not able to recognize theAR target. Accordingly, this method should not be used to track thetarget. If all AR tracking methods have an AR confidence score of 0 thenno tracking of the target is performed.

FIG. 8 shows a perspective view of an active augmented reality tapecomponent 800 with a portion of the tape extended. FIG. 9 shows aperspective view of an active augmented reality tape component with thetape retracted. FIG. 10 shows a perspective view of a portion of a datacenter asset rack of a data center with an active augmented reality tapecomponent with a portion of tape extended.

In various embodiments, an active augmented realty tape component 800includes a control portion 810, a tape portion 812 and an end portion814. In various embodiments, the control portion include some or all ofthe components of an information handling system 100. In variousembodiments, the control portion 810 includes a wireless communicationfunction such as a BLE function. In various embodiments, the controlportion communicates with an AR device without the need to pair thecontrol portion 810 with the AR device. In various embodiments, thecontrol portion 810 includes an accelerometer to detect whether theactive augmented reality tape component 800 is in a horizontalorientation or a vertical orientation. In various embodiments, thecontrol portion 810 includes an information display 820. In variousembodiments, the control portion 810 controls the informational displayto present information. In various embodiments, the information ispresented in a horizontal view or a vertical view depending on theorientation of the active augmented reality component 800. In variousembodiments, the information may include position information. Invarious embodiments, the position information can include informationregarding a location of a column with which the active augmented realitytape component is associated. In various embodiments, the informationcan include information regarding a distance the tape portion 812 hasbeen extended from the control portion. In various embodiments, thisinformation may be presented using a rack unit scale (e.g., U42). Invarious embodiments, the information is obtained by the control portion810 interacting with one or more of a data center management system 208and a data center administrator system 212 and an AR database 216.

In various embodiments, the control portion 810 includes one or morecontrol keys 830. In various embodiments, the control keys 830 enable auser to control the information presented on the display 820. In variousembodiments, an AR device which is in communication with the controlportion 810 can also control the information presented on the display820. In various embodiments, the control keys 830 enable a user toselect one or more of a data center asset rack height, a data centerasset rack number, a data center asset aisle number and a data centerasset column number. In various embodiments, the tape portion 812include one or more unique identifiers. In various embodiments, thecontrol portion 810 includes one or more magnets 840. In variousembodiments, the magnets 840 are positioned on the control portion sothat the active augmented reality tape component 800 may be removableattached to an underside of a top rail of a column of a data centerasset rack (see e.g., FIG. 10 ). In various embodiments, the end portion814 also includes a magnet to maintain the position of the tape portion812 when the tape portion 812 is extended. In various embodiments, whenthe tape portion is retracted, the end portion 814 is contiguous withthe control portion 810. In various embodiments, the control portion 810includes a retraction mechanism which causes the tape portion 812 toretract when the end portion 814 is not attached to a data center rack(e.g., via the magnet of the end portion 814).

In various embodiments, the tape portion 812 includes a plurality ofunique identifiers. In various embodiments, the tape portion 812includes unique identifiers corresponding to predetermined heights ofdata center assets in a column. Accordingly, when the tape is attachedto a data center rack column, each rack unit height would have a uniqueidentifier. For data center assets having heights of multiple rack units(e.g., 2RU, 4RU, 6RU), a particular data center asset would have aplurality of unique identifiers associated with the particular datacenter asset. Having a plurality of unique identifiers allows morespecific height location information to be associated with the datacenter asset. Having a plurality of unique identifiers enables an ARdevice to identify a particular location even when the AR device onlysees a portion of the AR tape portion 812.

FIG. 11 shows a perspective view of a passive augmented reality tape1100. FIG. 12 shows diagrammatic block diagram of an example roll of apassive augmented reality tape. In various embodiments, a passiveaugmented reality tape 1100 may be rolled for transport and use. Incertain embodiments, a passive augmented reality tape 1100 includes astart indication 1110. In various embodiments, the start indication 1110instructs a user to start the passive augmented reality tape at thebottom of a data center rack column.

In various embodiments, a single manufactured roll of passive augmentedreality tape 1200 can include lengths for a plurality of data centerrack columns (i.e., a large manufactured roll). In various embodiments,each length corresponds to 42 rack units. In various embodiments, withineach length, the tape includes a plurality of unique identifiers. Invarious embodiments each particular rack unit includes a respectiveunique identifier. Accordingly, when the tape is attached to a datacenter rack column, each rack unit height would have a uniqueidentifier. For data center assets having heights of multiple rack units(e.g., 2RU, 4RU, 6RU), a particular data center asset would have aplurality of unique identifiers associated with the particular datacenter asset. Having a plurality of unique identifiers allows morespecific height location information to be associated with the datacenter asset. Having a plurality of unique identifiers enables an ARdevice to identify a particular location even when the AR device onlysees a portion of the AR tape portion.

In certain embodiments, the graphics on the large manufactured roll oftape are known values. Each section on a manufactured roll is unique. Incertain embodiments, the graphics the tape sections on a largemanufactured roll are randomized by increasing the number of sections ona roll. Generating a long enough roll reduces the possibility of havingthe same tape in the same environment. Such a large manufactured rollcreates a random deployment of tapes with known U height values.

As used herein, attach broadly refers to the joining of two components,either removably or semi permanently joined. As used herein, removablyjoined broadly refers to joining where the components may be separatedwithout any damage to either of the components. For example, a removablejoin may be affected via the use of magnets. As used herein, semipermanently joined broadly refers to joining where one or both of thecomponents may suffer damage or may make it more difficult to reuse oneor both the components upon separation. For example, a semi-permanentjoin may be affected via the use of adhesive. Magnets and adhesive aretwo examples of means for joining the two components.

In various embodiments, AR tapes may be used with unique identifierplacement, augmented reality unique identifier placement and augmentedreality tracking handoff when performing an augmented reality operationsuch as an augmented reality projection operation or a combinationthereof.

As will be appreciated by one skilled in the art, the present inventionmay be embodied as a method, system, or computer program product.Accordingly, embodiments of the invention may be implemented entirely inhardware, entirely in software (including firmware, resident software,micro-code, etc.) or in an embodiment combining software and hardware.These various embodiments may all generally be referred to herein as a“circuit,” “module,” or “system.” Furthermore, the present invention maytake the form of a computer program product on a computer-usable storagemedium having computer-usable program code embodied in the medium.

Any suitable computer usable or computer readable medium may beutilized. The computer-usable or computer-readable medium may be, forexample, but not limited to, an electronic, magnetic, optical,electromagnetic, infrared, or semiconductor system, apparatus, ordevice. More specific examples (a non-exhaustive list) of thecomputer-readable medium would include the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a portable compact disc read-only memory (CD-ROM), anoptical storage device, or a magnetic storage device. In the context ofthis document, a computer-usable or computer-readable medium may be anymedium that can contain, store, communicate, or transport the programfor use by or in connection with the instruction execution system,apparatus, or device.

Computer program code for carrying out operations of the presentinvention may be written in an object oriented programming language suchas Java, Smalltalk, C++ or the like. However, the computer program codefor carrying out operations of the present invention may also be writtenin conventional procedural programming languages, such as the “C”programming language or similar programming languages. The program codemay execute entirely on the user's computer, partly on the user'scomputer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Embodiments of the invention are described with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems) andcomputer program products according to embodiments of the invention. Itwill be understood that each block of the flowchart illustrations and/orblock diagrams, and combinations of blocks in the flowchartillustrations and/or block diagrams, can be implemented by computerprogram instructions. These computer program instructions may beprovided to a processor of a general purpose computer, special purposecomputer, or other programmable data processing apparatus to produce amachine, such that the instructions, which execute via the processor ofthe computer or other programmable data processing apparatus, createmeans for implementing the functions/acts specified in the flowchartand/or block diagram block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meanswhich implement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

The present invention is well adapted to attain the advantages mentionedas well as others inherent therein. While the present invention has beendepicted, described, and is defined by reference to particularembodiments of the invention, such references do not imply a limitationon the invention, and no such limitation is to be inferred. Theinvention is capable of considerable modification, alteration, andequivalents in form and function, as will occur to those ordinarilyskilled in the pertinent arts. The depicted and described embodimentsare examples only, and are not exhaustive of the scope of the invention.

Consequently, the invention is intended to be limited only by the spiritand scope of the appended claims, giving full cognizance to equivalentsin all respects.

1. A method for performing an augmented reality location operationcomprising: attaching an augmented reality tape to a plurality ofcomponents, the augmented reality tape comprising a plurality of uniqueidentifiers, the augmented reality tape continuously extending acrossthe plurality of components; identifying an augmented reality target viaan augmented reality tracking method, the augmented reality targetcomprising the unique identifier of the augmented reality tape; and,generating an augmented reality projection to a location on a componentof the plurality of components based upon the identifying the augmentedreality target.
 2. The method of claim 1, wherein: the componentcomprises a data center asset rack; and, the location on the componentcomprises a location on a data center asset mounted in the data centerasset rack.
 3. The method of claim 1, wherein: the augmented realitytape comprises an active augmented reality tape.
 4. The method of claim3, wherein: the active augmented reality tape comprises a controlportion, a tape portion and an end portion.
 5. The method of claim 4,wherein: the control portion include a display, the display beingcontrolled to present information regarding a location of the activeaugmented reality tape.
 6. The method of claim 1, wherein: the augmentedreality tape comprises a passive augmented realty tape; the passiveaugmented reality tape comprising a means for attaching the augmentedreality tape to the component.
 7. An apparatus comprising: an augmentedreality tape, the augmented reality tape comprising p2 a plurality ofunique identifiers; and, an attachment means, the attachment meansenabling the augmented reality tape to be attached to a plurality ofcomponents, the augmented reality tape extending across the plurality ofcomponents; and wherein the plurality of unique identifiers enable anaugmented reality device to identify an augmented reality target, theaugmented reality target comprising at least one of the plurality ofunique identifiers of the augmented reality tape; and, the augmentedreality device generates an augmented reality projection to a locationon the component based upon the identifying the augmented realitytarget.
 8. The apparatus of claim 7, wherein: the component comprises adata center asset rack; and, the location on the component comprises alocation on a data center asset mounted in the data center asset rack.9. The apparatus of claim 7, wherein: the augmented reality tapecomprises an active augmented reality tape.
 10. The apparatus of claim9, wherein: the active augmented reality tape comprises a controlportion, a tape portion and an end portion.
 11. The apparatus of claim10, wherein: the control portion include a display, the display beingcontrolled to present information regarding a location of the activeaugmented reality tape.
 12. The apparatus of claim 7, wherein: theaugmented reality tape comprises a passive augmented realty tape.